Look and ye shall hear: Selective auditory attention modulates the audiovisual correspondence effect.

One of the unresolved questions in multisensory research is that of automaticity of consistent associations between sensory features from different modalities (e.g. high visual locations associated with high sound pitch). We addressed this issue by examining a possible role of selective attention in the audiovisual correspondence effect. We orthogonally manipulated loudness and pitch, directing participants' attention to the auditory modality only and using pitch and loudness identification tasks. Visual stimuli in high, low or central spatial locations appeared simultaneously with the sounds. If the correspondence effect is automatic, it should not be affected by task changes. The results, however, demonstrated a cross-modal pitch-verticality correspondence effect only when participants' attention was directed to pitch, but not to loudness identification task; moreover, the effect was present only in the upper location. The findings underscore the involvement of selective attention in cross-modal associations and support a top-down account of audiovisual correspondence effects.

Critical bottom-up attentional factors in the handle orientation effect: asymmetric luminance transients and object-center eccentricity relative to fixation.

In 1998, Tucker and Ellis found that keypress responses are faster when the task-irrelevant orientation of a graspable object's handle corresponds to response hand location. Over the past 20 years, researchers have disagreed over the extent to which grasping affordance or spatial compatibility contributes to the effect. One of the causes behind the conflicting findings and interpretations may be that studies advocating the grasping affordance view have tended to overlook the contributions of low-level perceptual characteristics to the observed correspondence effects. The present study evaluated the role of visual salience and bottom-up attention in the occurrence of the effect. Experiment 1 involved a vertical orientation task (bimanual keypresses) using photographs of graspable objects, centered based on object width or pixel area. The same procedure was performed using a color discrimination task on solid-colored silhouettes, large (Experiment 2) and small-sized (Experiment 3), as well as silhouette outlines (Experiment 4). Similar result patterns across Experiments 1-3 were observed and discussed in the context of diverging findings in Experiment 4, prompting us to introduce the notion of asymmetry-based Simon effects, whereby location is coded at stimulus onset on the basis of asymmetric changes in luminance between both hemifields, coupled with object-center eccentricity relative to fixation. These low-level factors were critical in modulating the temporal dynamics, as well as the direction of compatibility effects (toward handles or bodies), irrespective of grasping affordance, task, object identity, or stimulus size. The present findings provide further evidence that the Tucker and Ellis paradigm for studying variable affordances is extremely vulnerable to location-coding, which may arise on the basis of exogenous deployments of attention. This problem is only exacerbated in a large portion of the relevant literature, whereby visually complex stimuli are primarily discussed in terms of their graspable nature and relation to task, rather than their low-level, attention-capturing features.

Manipulating the Alpha Level Cannot Cure Significance Testing.

We argue that making accept/reject decisions on scientific hypotheses, including a recent call for changing the canonical alpha level from p = 0.05 to p = 0.005, is deleterious for the finding of new discoveries and the progress of science. Given that blanket and variable alpha levels both are problematic, it is sensible to dispense with significance testing altogether. There are alternatives that address study design and sample size much more directly than significance testing does; but none of the statistical tools should be taken as the new magic method giving clear-cut mechanical answers. Inference should not be based on single studies at all, but on cumulative evidence from multiple independent studies. When evaluating the strength of the evidence, we should consider, for example, auxiliary assumptions, the strength of the experimental design, and implications for applications. To boil all this down to a binary decision based on a p-value threshold of 0.05, 0.01, 0.005, or anything else, is not acceptable.

Neuropsychological and neuroimaging markers in prediction of cognitive impairment after ischemic stroke: a prospective follow-up study.

BACKGROUND: There are few longitudinal studies with controversial results examining delayed changes in cognition after ischemic stroke and predictive values of neuropsychological and neuroimaging markers. OBJECTIVE: The objectives of this study were to evaluate the delayed changes in cognition in poststroke patients and their relationship to the neuropsychological and neuroimaging markers measured during the acute poststroke phase. METHODS: Eighty-five first-ever stroke inpatients (mean age 65.6±5.6 years) without previous cognitive complaints were prospectively evaluated with a comprehensive neuropsychological battery at the 5th day and the 1st, 6th, and 12th months. A wide range of clinical, radiological, and neuropsychological variables were examined. RESULTS: Our results showed significantly poorer performance on mini-mental state examination, memory, attention/executive functions, and processing speed in patients with stroke in comparison with stroke-free cognitively intact controls. Multiple regression analysis revealed that hippocampal atrophy is the strongest predictor of delayed cognitive impairment. Secondary divided subgroups according to Isaacs Set Test (IST) score showed that patients with IST score ≤28 had different patterns of cognitive and neurological impairment after 1 year. Baseline impairments in attention/executive functions and memory were associated with development of dementia in poststroke patients. CONCLUSION: Executive functioning deficit appears to have a predictive power for cognitive impairment progression. The study suggests that IST as a screening test has a potential to be a reliable and quick tool for poststroke cognitive impairment evaluation and delayed cognitive and neurological outcome. Hippocampal atrophy was the strongest predictor for cognitive impairment outcome, even in poststroke cognitive impairment. The findings may set the stage for better poststroke management.

Metaphorical Salience in Artistic Text Processing: Evidence From Eye Movement.

The study aimed to explore processing difference between a literal phrase and a metaphoric one. Unlike artificially created stimuli in most experimental research, an artistic text with an ambiguous binary metaphoric phrase was used. Eye tracking methodology was applied. Results suggested difference between the two types of phrases in both early and late processing measures.

Remember down, look down, read up: Does a word modulate eye trajectory away from remembered location?

Previous studies show that eye movement trajectory curves away from a remembered visual location if a saccade needs to be made in the same direction as the location. Data suggest that part of the process of maintaining the location in working memory is the mental simulation of that location, so that the oculomotor system treats the remembered location as a real one. Other research suggests that word meaning may also behave like a 'real object' in space. The current study aimed to combine the two streams of research examining the effect of word meaning on the memory of a dot location. The results of two experiments showed that word meaning for 'up' (but not 'down') modulated both eye movement trajectory and location recognition time. Thus, mental simulation of task-irrelevant space-related word meaning affected both earlier stages of memory processes (maintenance of the location in the working memory) and later ones (location recognition).

Reversing the affordance effect: negative stimulus-response compatibility observed with images of graspable objects.

Responses are faster when the task-irrelevant orientation of a graspable object's handle corresponds to the location of the response hand. Over the past decade, research has focused on dissociating between two competing accounts of this effect: One rooted in motoric object affordances and the other resting on attentional mechanisms (i.e., Simon effect). Following this avenue of inquiry, we conducted three experiments, in which subjects had to respond bimanually to grayscale photographs of frying pans and saucepans. In addition to horizontal orientation (control/leftward/rightward handles), Experiments 1 and 2 also manipulated the direction of exogenous attentional shifts (left/right) using laterally placed, colored markers within the objects. Both experiments yielded regular Simon effects based on the location of the colored markers. However, in stark contrast to previous research, a negative stimulus-response compatibility effect was obtained with regard to the orientation of the graspable handles. This reversed affordance effect was also observed using the original, unedited grayscale photographs (Experiment 3), which suggested that its occurrence cannot be attributed to the use of colored markers. These unexpected findings appear to support the idea that Simon effects result from automatic and exogenous attentional orienting mechanisms, whereas affordances arise from controlled and endogenous attentional processes. Such a top-down attentional account of affordance can accommodate the observed reversal of the effect in the context of task characteristics.

When left feels right: asymmetry in the affordance effect.

Previous research has demonstrated the existence of the so-called affordance effect (faster response when the visual affordance of a graspable object (e.g., a pan) corresponds to the response location). It has been argued that the effect is due to abstract spatial coding of the position of the handle relative to the object instead of the grasping affordance. Our experiment tested the hypothesis that the affordance effect is not caused solely by abstract spatial coding but also by specific motor activation in response to the visual affordance. We assumed that, in the case of abstract spatial codes, response location and not hand distinction would be the critical factor for producing an affordance effect. In our experiment, bi-manual crossed/uncrossed responses to left/right symbols superimposed on a picture of a pan were used. The task was to attend to the symbol and to press a corresponding left/right button. Affordances of the pan were manipulated. A three-way interaction between side of affordance (left/right), mode of response (crossed/uncrossed hands), and response-affordance correspondence (corresponding/non-corresponding) showed a correspondence effect in the right affordance condition with hands uncrossed and no correspondence effect with hands crossed. The correspondence effect was obtained in the left affordance condition across hand positions that differed only by their magnitude. Overall, the results suggest that both mechanisms (grasping affordance and spatial codes) differentially contribute to the processing of an object with a graspable handle, depending on the affordance side and response hand.

The role of attention in the affordance effect: can we afford to ignore it?

It has been established that the task-irrelevant orientation of an object's graspable handle produces a stimulus-response compatibility effect, resulting in faster reaction times when the location of the response corresponds to that of the object's handle. There is ongoing debate whether to attribute this affordance effect to motoric or to attentional components. In an attempt to reconcile these two viewpoints, we employed a novel experimental approach for investigating the relationship between attention and affordance. Using 3-D positional sound, auditory spatial attention was manipulated in order to explore its effects on affordance. Subjects were presented images of everyday graspable objects and had to respond bimanually (left or right) whether the object (featuring a leftward or rightward handle) was presented upright or upside-down. Prior to each affording object, sound localization cues were manipulated so as to orient auditory attention to the left, or to the right of the interaural axis (control). We obtained a peculiar pattern of results, which not only appears to provide support for an attention-shift account of affordance but does so in a cross-modal context.

Combining motor and spatial affordance effects with the divided visual field paradigm.

The affordance effect has been widely investigated employing various behavioral and brain-imaging techniques. Attempts to interpret the nature of the affordance effect led to two major views. Some researchers compare this kind of compatibility effect to the Simon effect, claiming abstract spatial association between the handle orientation of visually presented stimuli and the nearest response hand. Other authors advocate pure motor activation, during processing of visually presented tools without the involvement of spatial information. However, brain-imaging studies seem to agree that no action can be computed in the absence of spatial information. Taking the latter view into account, a divided visual field experiment was conducted, with the aim of crossing spatial and affordance correspondence effects. Overall, the results supported the view that motor and spatial information go hand in hand. Moreover, the data were in agreement with neuroimaging studies that show tool and affordance processing lateralization in the left hemisphere. The results are discussed in terms of neurophysiological data and brain mechanisms of perception and action.

Common dynamic properties of biosignals during cognition: self-similarity and chaotic dynamics of both response times and EEG during movement imagery.

This study was undertaken to verify whether different output variables or biosignals, measured during performance of a cognitive task, manifest common dynamical properties. Nonlinear properties of both response times (RTs) and electroercephalograms (EEG) were tested. We asked subjects to generate mental images of actions following of auditorily presentation simple phrases suggesting the action. Analysis of RT series combined from many subjects and of EEG records from single subjects clearly manifested self-similarity and chaotic dynamics that provide insights into the self-organization of the brain/behavioral system.